Role of free energy landscape in the dynamics of mean field glassy systems 
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" f-^ " . In this paper we expose the results of our recent work on the dynamical TAP approach to mean 

' field glassy systems. Our aim is to clarify the connection between free energy landscape and out of 

equilibrium dynamics in solvable models. 
£N| ■ Frequently qualitative explanations of glassy behaviour are based on the "Free Energy Landscape 

> | ' Paradigm" . If its relevance for equilibrium properties is clear, the relationship between free energy 

landscape and out of equilibrium dynamics is not well understood yet. In this paper we clarify this 
relationship for the class of spin glass models which reproduce phenomenologically some features of 
structural glasses. The method we use is a generalisation to dynamics of the Thouless, Anderson 
■ and Palmer approach to thermodynamics of mean field spin glasses. Within this framework we 

show to what extent the dynamics can be represented as an evolution in the free energy landscape. 
In particular the relationship between the long-time dynamics and the local properties of the free 
(— 1 ■ energy landscape shows up explicitly using this approach. 
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03 ■ I. INTRODUCTION 



Generally in the study of thermodynamics much attention is payed to the free energy landscape Q . This landscape, 
which can be interpreted as the effective potential whose minima represent different possible states, gives an intuitive 
and quantitative description of the equilibrium properties. Consider for example ferromagnetic systems. In this case 
the effective potential is a function of magnetisation. The ferromagnetic transition corresponds to the splitting of the 
paramagnetic minimum in the two ferromagnetic minima. At low temperature a vanishing external magnetic field 
breaks the up-down symmetry and fixes the system in one of the two possible ferromagnetic states. 
Generally, glassy systems are characterised by a complicated energy landscape, which can give rise eventually to 
■^j- ■ the existence of many possible states. Frequently, qualitative explanations of glassy behaviours are based on some 
assumptions on the properties of the free energy landscape Q. Consider for example the Kirkpatrick-Thirumalai- 
■ Wolynes scenario for the glass transition J2||5| in which the (exponential) number of states with a given free energy 
plays a crucial role. 

However, if the relevance of the free energy landscape for the equilibrium properties is clear, the relationship between 
the free energy landscape and the dynamical behaviour is not completely understood, especially for glassy systems 
which remain out of equilibrium also at long time. For instance what we can learn on the (out of equilibrium) 
' dynamical behaviour starting from the knowledge of the free energy landscape is not clear. 

All the explanations based on the free energy landscape remain often at a qualitative level, because in general 
1 this landscape cannot be computed and studied exactly. Only for mean field frustrated systems this "Landscape 
Paradigm" Q] has received a firm theoretical basis. In this case an analytic solution of the thermodynamics PJ and 
of the asymptotic out of equilibrium dynamics (^] is available. For these systems the free energy landscape can be 
computed [p|-|Ll"| and the partition function, and therefore the equilibrium properties, can be recovered as a sum 



over the free energy minima weighted with the Boltzmann factor |12|. This approach to the thermodynamics of 
mean field spin glasses is called the TAP approach, because it was introduced by Thouless, Anderson and Palmer 
for the Sherrington-Kirkpatrick model [|l3| . In this paper we focus on the class of spin glass models which reproduce 
phenomenologically some features of structural glasses 0,0 ■ To understand the relationship between free energy 
d ' landscape and dynamical behaviour we generalise the TAP approach to dynamics. 



II. THE TAP APPROACH 
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A. Static TAP equations 



In the following we show how the free energy landscape, also called TAP free energy, can be derived for the p-spin 
spherical model . The aim of this section is to present in a simple case the strategy which we have followed [y| 
to compute the dynamical TAP equations. 
The p-spin Hamiltonian reads: 

H({S l }) = - J2 ■>■ ■ ■ 'v-- s '<. . (!) 

l<ii<-<j„<JV 



where the couplings are Gaussian variables with zero mean and average Jf ... i = 2 atp-i ■ The TAP free energy 
T{j3,rrii,l), which depends on the magnetisation rrii at each site i and on the spherical parameter I, is the Legendre 
transform of the "true" free energy: 



r + oo N I 

i Y[dSiexp[-0H({Si}) 

i=i V 



0T(0, mi ,l) =ln / \\dSiexp[-0H({Si})-Y,hi(Si-rni)-'i^(!%-l)\ ■ (2) 




The Lagrange multipliers hi{0) fix the magnetisation at each site i: (Si) — m, and X(0) enforces the condition 
J2i—i (S? — l) = 0. (•) denotes the thermal average and N is the number of spins. 

Once r is known, the equation —jf^gf- — A fixes the spherical constraint Sf = N) and gives the spherical 

multiplier as a function of mi, whereas — jr^- = hi arc the TAP equations, which fix the values of local magneti- 
sations. 

The standard perturbation expansion for the generalised potential T is rather involved Jl^,^| and cannot be directly 
applied to the Ising case. Thus, we prefer to follow the approach developed for the Sherrington-Kirkpatrick model 
by T. Plefka |HJ and A. Georges and S. Yedidia jDJ because it is simple and can be directly applied to all mean 
field spin glass models. They obtained the TAP free energy for the Sherrington-Kirkpatrick model expanding — 0T in 
powers of around = 0. For a general system this corresponds to a j expansion (d being the spatial dimension) 
around mean field theory [ 111] ; so it is not surprising that for mean field spin glass models only a finite number of 
terms survives. The zeroth- and first-order terms give the "naive" TAP free energy, whereas the second term is the 
Onsager reaction term. 

From the definition of — 0T given in equation (^|), we fincj^j that the zeroth-order term is the entropy of non 
interacting spherical spins constrained to have magnetisation mc 



0T{0,m h l) 



13=0 



2 \ 1 



(3) 



Using the Lagrange conditions and that the spins are decoupled at = we find that the linear term in the power 
expansion of the TAP free energy equals: 
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E 

[3=0 l<ii<---<i p <N 



v m ix ■ ■ ■ m ip . (4) 



This "mean field" energy together with the zeroth-order term gives the standard mean field theory, which becomes 
exact for infinite-ranged ferromagnetic system. The Onsager reaction term comes from the second derivative of T: 



2 d 2 (0T) 



d0 2 
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(5) 
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1 We are neglecting a useless additive constant in T. A term in F, that does not depend on I and m;, has no influence on 
thermodynamics . 
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To compute (||) we have used the following Maxwell relations: 
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Using the statistical properties of the couplings it is easy to check that the only terms giving a contribution of the 
order of N correspond to the squares of Ji Xl ...,i p : 
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Using again the statistical properties of the couplings and neglecting terms giving a contribution of an order smaller 
than N we find that the reaction term depends on m, through the overlap q = -k J2i m i only: 
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Higher derivatives lead to terms which can be neglected because they are not of the order of N dJl^l ; so collecting 
(H):(|J) an d @ w e find the TAP free energy for spherical p-spin models. Differentiating the free energy with respect 
to magnetisations rrii and the spherical parameter I one finds the TAP equations. These equations admit for certain 
temperatures an infinite number of solutions. This is a fundamental characteristic and difficulty of mean field spin 
glasses. 

It has been shown jl2|,^| that the weighted sum of the local minima of the TAP free energy gives back equilibrium 
results found by the replica or the cavity method |Q: Z = J2 a e _A W Q , where f a is the TAP free energy of a stable 
solution {mf } of TAP equations. Note that states which do not have the minimum free energy can dominate the 
previous sum if their number is very large. 

Let us conclude this section with few comments on the derivation of the static TAP equations. First of all we remark 
that we have improperly called T(j3,rrii,l) a Legendre transform. Indeed the function r(/3, m*,/) is the generating 
functional of proper vertices [ pT[ . This function may have many minima and is not convex in general. Finally we 
want to point out a striking difference, which arises in the computation of T, between completely connected and finite 
connectivity mean field models. For the former the expansion of T in powers of (3 stops at the second order in (3. 
Whereas for the latter the expansion contains all the powers of (3. Roughly speaking for the Sherrington-Kirkpatrick 
model the only non trivial term in Y is the reaction term, which represents the contribution to the effective field of 
the zth spin due to the influence of the «th spin on the others. Whereas for its counterpart on a Bethe lattice Ji"8 11 
the interaction between two neighbouring spins has to be taken into account exactly, i.e. one has to take into account 
not only the reaction of the neighbours of Si due to the presence of Si , but also the reaction of the reaction and so 



B. Dynamical TAP equations 

In the following we focus on a Langevin relaxation dynamics for mean field glassy systems. Standard field theoretical 
manipulations JL7J lead to the Martin-Siggia-Rose generating functional for the expectation values of Si(t). 
Within the superspace notation [ [i"7|JT9| ] the dynamics and the static theory are formally very similar [1S||. As a 
consequence dynamical TAP equations can be derived straightforwardly generalising the method described in the 
previous section. We refer to Jl5| for a detailed derivation. Once the dynamical TAP free energy is known, the 
dynamical TAP equation are obtained from the Lagrange relation for the supermagnetisation. In the following we 
simply quote the result Pq|: 
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^(C(t,t')-Q(t,t')) = 2R(t',t) - X(t)(c(t,t') - Q{t,t')) +n J* dt"(c{t,t"f- 1 - Q(t,t")P^)R(t\n 

+ /i(p-l) J dt"(c(t",t')-Q(t",t')^R(t,t")C(t,t") p - 2 , (10) 

^R(t, t') = -X(t)R(t, t') + 6(t - t') + n(p -1) J dt"R(t, t")R(t", t')C(t, t") p ~ 2 , (11) 
— +\(t))mi(t)=phi(t)+P J i,i2,...,i P m i2 (t)---m ip (t) 



l<i 2 <...<i p <N 
t 



+ v( P -i)j^dt>>(c(t,t'r- 2 -Q(t,tY- 2 ))moMn , as) 

where C(t,t') = J^iLi (si is the correlation function, R(t,t') = X^ili 9 dhl(t<) 1S ^ ne res P on se function 
to magnetic fields hi(t) coupled to the spins Si, Q{t,t') — jj m i{t) m i(t') is the overlap function, rrii(t) are the 

local magnetisation, fi = pf3 2 /2 and X(t) is the spherical constraint which fixes C(i, t) = 1. The correlation function 
satisfies the boundary condition C(t, 0) = Q(t, 0) and magnetisations fulfil the initial conditions rrii(0) = s° . Note 
that now (•) means the average over the thermal noise. 

Moreover the spherical condition C(t, t) = 1 fixes A as a function of time through the equation: 



A(t)(i -<?(*)) =i + ig +M ^ dt"{c{t,t"Y^ -QitXY'^R^t") 

+ V( P -1) dt"(c(t",t)-Q(t",t)^R(t,t")C(t,t"f- 2 , (13) 



where q(t) = Q(t, t). 

Three important remarks are in order on these equations. First of all if one takes for initial condition a uniform 
average over all possible configurations as in pop, then the magnetisations are equal to zero at t = and there is no 
boundary condition on the correlation function |l5|] . In this case we find that the equation ( |l2|) is trivially satisfied and 
equations ([h]), ( pi] ) and (|l3|) reduce to the ones considered in p0| . Moreover we notice that in the zero temperature 
limit the equation ( |l2|) coincides with a simple gradient descent, as should be when the thermal noise is absent. 
Finally, it is interesting to remark that the equations on local magnetisations do not have at finite times the form of 
a gradient descent in the free energy landscape since the Onsager reaction term is non-Mar kovian. This is natural 
because it represents the contribution to the effective field of the ith spin due to the influence at previous times of 
the ith spin on the others. 



C. Asymptotic analysis 

In the following we perform an asymptotic analysis of the equations (|Io|), (|Tl|), ( |l^ ) and ([l3]). For the sake of 
simplicity we will take hi(t) = in (|l2|). 

Two asymptotic behaviour have been found for the p-spin spherical model depending on the choice of the initial 
conditions I2CH2T 



• True ergodicity breaking: the system equilibrates in a separate ergodic component. Asymptotically time homo- 
geneity and fluctuation-dissipation theorem (FDT) hold pl| , p2| . In this case, following plp^ ], we take for the 
asymptotic form of the two time quantities the Ansatz: 

C(t,t') = C FDT (t-t') , R{t,t')=R FDT (t-t') (14) 

Rfdt(t) = -6(r) dCF ° T{T) , Q(t,t') = q (15) 

lim C F dt{t) = q. (16) 
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• Slow dynamics: the system does not equilibrate. Asymptotically two time sectors can be identified. In the first 
one (FDT regime), which corresponds to finite time differences \t — 1'\ ~ 0(1), (t >> I, t' >> I), the system has 
a pseudo-equilibrium dynamics since FDT and time translation invariance hold asymptotically. In the second 
one (ageing regime), which corresponds to "infinite" time differences \t — t'\ ~ t', FDT and time translation 
invariance do not apply and the system ages po| . In this case, following pp|] , we take for finite time separations 
the Ansatz corresponding to equilibrium dynamics, but with Q(t',t) = q' . Whereas for the ageing sector we 
take the Ansatzf] |2(]]: 

C(t,t')=qC ag (X) , tR(t,t') = R ag (X) (17) 
dC 

R ag (X) = xq— , Q(t,t')=qiQ ag (\) (18) 

C ag (l) = Q ag (l) = 1 , X = J, (19) 

where x parameteriscs the violation of FDT . 
The asymptotic solutions arising from the previous Ansatze can be grouped in three classes. 



1. Equilibrium dynamics. 

We denote respectively by A°° and m°° the asymptotic values of the spherical multiplier and of the local magneti- 
sations. Plugging the equilibrium dynamics Ansatz into the dynamical TAP equations we find that the equations on 



m°° and A°° are the corresponding static TAP equations. In the asymptotic limit the equations (|1C|) and (11) on the 
correlation and the response functions reduce to: 

4- + A°° - fx) C(t) + ,i + 1 - A°° = -fx f T dr'C{T - r'f- 1 . (20) 

dr J J dr' 

The above equation describes the equilibrium dynamics inside the ergodic component associated to a TAP solution 
{ra?°}. Note that this asymptotic dynamical solution is consistent with the assumption of an equilibrium dynamics 
only if {m°°} is a local minimum of the free energy. 

Since this asymptotic solution represents the equilibration in a stable TAP state {m°°}, it is quite natural to associate 
to this solution an initial condition belonging to this state. This interpretation is suggested by the results of pl| , p2| . 
Indeed in ]2l],^2| the low temperature dynamics has been studied starting from an initial condition belonging to the 
TAP states which are the equilibrium states at a temperature T". In |^,P2| it has been shown that the system relaxes 



in the TAP states associated to the initial condition. It is easy to show that the equation satisfied by C(r) in J21 22 
can be written in the form (^o|). 

Moreover it is interesting to note that the equations ( |l2| ) on local magnetisations reduce in the long-time limit to a 
gradient descent in the free energy landscape with an extra term which vanishes at large time. 



2. Weak ergodicity breaking. 

The asymptotic analysis in the time sector corresponding to finite time differences leads to the same equation ( |20| ) 
for the correlation and the response functions. Whereas for infinite time differences we find that the asymptotic 
equations admit the solution: q' = 0, q which verifies the equation of the overlap of the threshold states 
x = < " p ~ 2 ^ 1 ~ q " > and C ag (\) and R ag (\), which satisfy the same equations found in pp[j . The equation ( |l3| ) on the 
spherical multiplier reduces to: A°° = (1 — q)^ 1 + /i(l — g p_1 ) and the asymptotic value of the local magnetisations 
m°° is zero. This is exactly the same asymptotic solution found in [^of for random initial conditions. Therefore it 
is natural to associate to this solution a random initial condition, which is not correlated with any particular stable 



2 The asymptotic equations are obtained neglecting the time derivatives. This has as a consequence that from an asymptotic 
solution we obtain infinitely many others by re-parameterisatio n |pd] . For the sake of clarity in the following we focus on the 
particular parameterisation shown in equations (^), ( |l8| ) and (JlS)) - 
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TAP state. 

Note that the difference between q and q' cleariy marks that the system does not equiiibrate in a single ergodic 
component. 

3. Between true and weak ergodicity breaking. 

In the following we consider the asymptotic solution which corresponds to slow dynamics with q = q' . In this case 
we find the same solution of section II. C. 2 except that q' = q and Q a g(A) = C ag (\). As a consequence the local 
magnetisations do not vanish in the long-time limit. These results indicate that at very large times the system has 
almost thermalized within a threshold state. Anyway the slow behaviour of the overlap function Q(t,t') implies that 
the local magnetisations evolve forever, even if more and more slowly. In other words if one waits a time t w (>> 1) 
the systems seems to be equilibrated in a certain threshold states on timescales At << t w ; however on timescales of 
the same order of t w the system continue to evolve. 

To understand the slow evolution of rm(t) it is important to recall that the threshold states are characterised by 
a spectrum of the free energy Hessian which is a semicircle law with minimum eigenvalue equal to zero [m]. As a 
consequence the free energy landscape around threshold states is characterised by almost flat directions. At large 
times, the equations satisfied by mj(t) corresponds to a gradient descent in the free energy landscape with an extra 
term which vanish in the long-time limit. Because of almost flat directions this vanishing term plays a fundamental 
role and is responsible for ageing. In fact at large times the dynamics takes place only along almost flat directions 
and this vanishing function of time acts as a vanishing source of drift, so the larger is the time, the weaker is the drift 
and the slower is the evolution: the system ages. 

Finally we remark that it seems natural that the initial conditions related to this asymptotic solution are the con- 
figurations typically reached in the long-time dynamics (starting from a random initial condition). In fact a way 
to obtain this asymptotic solution starting from a random initial condition is to introduce fields hi(t) which enforce 
the condition lim^oo l/N J^iLi m i(t) 2 = <?' = Qth (where q t h is the overlap of threshold states There are 

many different way to fix the fields hi(t) to enforce this condition; however for each realization of hi(t) it is clear 
that /•im(_ >00 /ij(t) = because the equality between q' and q t h is automatically verified in the long-time limit. The 
vanishing of the local magnetisations is due |23| to the many possible channels that the system can follow in the 
energy landscape. The role of magnetic fields hj\t) is to bring the system along one of the possible channel. 

III. FREE ENERGY LANDSCAPE AND LONG-TIME DYNAMICS 

At finite times, the dynamics cannot be represented as an evolution in the free energy landscape because the 
Onsager reaction term in ( |l2| ) is non-Markovian. However in the long time regime a connection between the free 
energy landscape and the dynamical evolution can be established. 

For initial conditions leading to an equilibrium dynamics, i.e. the equilibration in a stable TAP state {m°°}, the 
equations on the local magnetisations imply that the relaxation of {rrii(t)} toward {m°°} coincides with a gradient 
descent in the free energy landscape with an extra term going to zero at large times. 

Conversely, in the most interesting and the most physical case of random initial conditions (corresponding to a quench 
from infinite temperature) the local magnetisations vanish at large times. Anyway a description of the asymptotic 
dynamics as an evolution in the free energy landscape makes sense also in this case. The local magnetisations vanish 
asymptotically because the dynamical probability measure at large time tends toward a static probability measure 
which is broken in separate ergodic components, i.e. the threshold states. One can think at the probability density in 
configuration space as a wave packet which breaks continuously in sub-packets. Within this picture, the dynamical 
evolution is characterised by two effects: the cloning |23| of each packet in sub-packets and the slow motion of each 
single packet. To avoid the spreading of the dynamical measure and to capture only the slow motion, one can take for 
initial condition a configuration typically reached in the long-time dynamics (starting from random initial conditions) . 
This procedure leads to the asymptotic solution analysed in section II. C. 3, in which the correlation and the response 
functions have the same asymptotic behaviour that for a random initial condition. Moreover C(t,t') and Q(t,t') are 
equal in the ageing time regime. Thus, also the ageing dynamics obtained starting from a random initial condition can 
be represented in terms of the equation on rrii(t), i.e. as a motion in the flat directions of the free energy landscape. 

In conclusion, through the dynamical TAP approach we have shown that the long-time dynamics can be represented 
as a gradient descent in the free energy landscape with an extra term going to zero at large time. This result allow one 
to make a straightforward connection between static free energy landscape and long-time dynamics and to give to the 
former a meaningful dynamical interpretation. In fact, consider all the stationary and stable dynamical probability 
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distributions P a ({si(t)}). We have shown that the local magnetisations mf = (si) a calculated with the probability law 
Pa({si(t)}) are the local minima of the TAP free energy. This gives to static TAP solutions a dynamical interpretation 
in which the properties of stationarity and stability in the free energy landscape are directly related to the properties of 
stationarity and stability of dynamical distributions P a ({si(t)}). Moreover the relationship, that we have elucidated, 
between ageing and flat directions in the free energy landscape allows one to clarify the important role played by the 
threshold states in the slow dynamics: they are stable states having flat directions in the free energy landscape and 
as a consequence they are related to ageing dynamics. What is missing to a complete dynamical interpretation of the 
free energy landscape is the comprehension of the role played by the free energy barriers in the activated dynamics, 
i.e. to go below the threshold energy starting from random initial conditions. Recent progress in this direction has 
been done in [f24f . 

IV. CONCLUSIONS 

In summary we have found that for the p-spin spherical model the representation of the long-time dynamics as 
an evolution in the free energy landscape is correct. This evolution consists in a gradient descent in the free energy 
landscape with an extra term going to zero at large time. This vanishing source of drift depends on the history of 
the system and is crucial for slow dynamics. Our results explicitly show that the scenario for slow dynamics found 
at zero temperature |25|| remains valid also at finite temperature: ageing is due to the motion in the flat directions of 
the free energy landscape in presence of a vanishing source of drift. 

Finally, the relationship between long-time dynamical behaviour and local properties of the free energy landscape, 
which was already found in ]2C|~ [2^p^ | , shows up explicitly by the study of the dynamical TAP equations. This 
relationship is very important not only from a theoretical point of view, but also from a technical one. Indeed it 
allows to obtain information about the long-time dynamics by a pure static computation [{22|]27f l. For these reasons 
it would be very interesting to generalise the study performed in this article to finite dimensional systems. In this 
case the free energy landscape cannot be computed exactly and the long-time dynamics cannot be solved; however, 
the formal analogies (due to superspace notation) between static and dynamic theory let us hope that one can obtain 
results on the relationship between long-time dynamics and free energy landscape only using the symmetry properties 
of the asymptotic solution pS} ]. 
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